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Abstract. A methodology to analyze the properties of the first (largest) eigenvalue and its 
eigenvector is developed for large symmetric random sparse matrices utilizing the cavity method 
of statistical mechanics. Under a tree approximation, which is plausible for infinitely large 
systems, in conjunction with the introduction of a Lagrange multiplier for constraining the 
length of the eigenvector, the eigenvalue problem is reduced to a bunch of optimization problems 
of a quadratic function of a single variable, and the coefficients of the first and the second order 
terms of the functions act as cavity fields that are handled in cavity analysis. We show that 
the first eigenvalue is determined in such a way that the distribution of the cavity fields has 
a finite value for the second order moment with respect to the cavity fields of the first order 
coefficient. The validity and utility of the developed methodology are examined by applying 
it to two analytically solvable and one simple but non-trivial examples in conjunction with 
numerical justification. 



1. Introduction 

The first (largest) eigenvalue and its eigenvector (first eigenvector) play key roles in many 
problems in information science. In multivariate data analysis, the first eigenvector of the 
variance-covariance matrix represents the most significant component that underlies a set of data 
under the assumption that the data are generated from a multivariate Gaussian distribution, 
and the first eigenvalue indicates its relevance [1]. The well-known Google PageRank"'"^ ranks 
World Wide Web pages based on the first eigenvector of a transition matrix over a huge network 
of pages [2]. The first eigenvectors of certain matrices expressing a given graph can also be 
utilized as a practical solution to combinatorial problems such as graph three coloring- [3j and 
graph bisection problems [4J. 

The first eigenvalue problem is of significance in physics as well. The assessment of the 
ground state is generally formulated as a first eigenvalue problem in quantum mechanics [S]. It 
is generally difficult to accurately assess the correlations in spin systems in statistical mechanics. 
However, when the temperature is sufficiently high, spin correlations can be evaluated by 
replacing spin variables with so-called spherical spins in a class of systems [B] , which is practically 
reduced to the eigenvalue analysis of the interaction matrix. In particular, that for the first 
eigenvalue is of great relevance because it directly leads to the assessment of the critical 



temperature /mode for the emergence of spontaneous magnetization [7]. 

Many properties have thus far been clarified for the first eigenvalue problem for the ensembles 
of large dense matrices. For N x N symmetric matrices S whose entries are independently and 
identically distributed (i.i.d.) random variables of a zero mean and a variance of iV"\ the first 
eigenvalue asymptotically converges to 2 and the first eigenvector has no preferential directions in 
the iV-dimensional space as N tends toward infinity [8J. However, when a projection operator of 
a certain direction, d, is added to S with an amplitude, B, the asymptotic eigenvalue is switched 
to B + 1/B for B > 1 having a first eigenvector of a non-zero overlap with d. Similar results 
are also obtained for the correlation matrix, P'^X"^ X , of P x N matrices X whose entries 
i.i.d. random variables of a zero mean and variance N~'^, where T denotes the operation of the 
matrix transpose; the first eigenvalue is offered as + in the limit of A^, P — )• oo keeping 

a = P/N finite providing no preferential directions of the first eigenvector [U], and the analysis 
can also be generalized to cases in which the projection operators of several directions with 
arbitrary strengths are added [TO]. However, as far as we know, relatively little knowledge has 
been gained on ensembles of sparse matrices in which the density of non-zero entries vanishes 
as the size of the matrices tends to infinity although details on eigenvalue distributions have 
recently been unraveled for several cases [HI [12l [131 HH HSl US] • 

Based on such an understanding, we will herein examine the first eigenvalue and the 
distribution of components of the first eigenvector for a family of large symmetric random sparse 
matrices. To achieve this purpose, we employ the cavity method of statistical mechanics |17j . 
A major advantage of this scheme is its capability for deriving equations for macroscopically 
characterizing objective systems without having to resort to complicated computation that is 
generally demanded in an alternative approach termed the replica method |18j . on the basis of 
a tree approximation, which is intuitively plausible for large sparse matrices 

This paper is organized as follows. The next section introduces the model that will be 
explored. In section 3, we develop a scheme for examining the eigenvalue problem in a large 
system limit based on the cavity method. The scheme is applied to two analytically solvable 
and one simple but nontrivial examples in section 4. The final section is devoted to a summary. 

2. Model definition 

We consider ensembles of N x N real symmetric sparse matrices J = {Jij) that are characterized 
by a distribution, p{k), of degree k{= 0, 1, 2, . . .), which denotes the number of non-zero entries 
for a column/row in the limit of — t- oo. For simplicity, we assume that the diagonal elements 
of the matrices are always constrained to zero. For aspects other than degrees, we assume that 
the matrices are randomly constructed. Let us denote di as the degree of index i{= 1,2, ... , N). 
For k = 0, 1, 2, . . ., we set di = k for Np{k) indices of i = 1, 2, . . . , A'^. A practical scheme for 
generating a random configuration of non-zero entries characterized in the above is basically as 
follows [TO]: 

(S) Make a set of indices U to which each index i attends di times. Accordingly, we iterate the 
following (A)-(C). 

(A) Choose a pair of two different elements from U randomly. 

(B) Let us denote the values of the two elements as i and j. li i ^ j and the pair of i and j 
has not been chosen up to the moment, make a link between i and j, and remove the two 
elements from U . Otherwise, we return them back to U . 

(C) If U becomes empty, finish the iteration. Otherwise, if there is no possibility that any more 
links can be made by (A) and (B), return to (S). 

Links generated by the above procedure stand for pairs of indices i and j to which the 
non-zero entries of Jij are assigned. There may be other algorithms for randomly generating 



a configuration of the non-zero entries. However, we expect tliat the properties, which we will 
investigate after this, do not depend on the details of the generation schemes. 

When the support of p{k) is not bounded from the above and values of the entries are kept 
finite, the first eigenvalue generally diverges as N ^ oo [HI [12l [131 [HI [13 [ISj. To avoid 
this possibility, we assume that p{k) = for k, which is larger than a certain value, femax; 
unless infinitesimal entries are assumed. We also assume that the non-zero elements of Jij are 
determined as statistically independent samples following an identical distribution, pj{Jij). In 
cases where pj{Jij) is provided by a simple binary distribution, 



pj(J,,|A, J) = 5(Jy - J) + -^5{Jio + J) (1) 

(1 > A > 0, J > 0), where 5{x) denotes Dirac's delta function, these guarantee that the first 
eigenvalue A is bounded from the above by kmnxJ- 

In matrix ensembles of Erdos-Renyi type |20j . which have been widely studied in network 
science, a non-zero value of Jij is assigned to each pair of indices i > j with a certain probability, 
c/N, where c > is 0(1). This eventually leads to a Poissonian degree distribution as 
p{k) = e~'^c^ /kl, whose support is not bounded from the above. Therefore, the following analysis 
does not cover such ensembles as long as the matrix entries are 0{1). 



3. Cavity approach to first eigenvalue problem 

3. 1 . Message passing in fixed graph 

Formulating the first eigenvalue problem as a constrained quadratic optimization problem 

niin |— i?"^ Ji?} subject to \v\^ = N 

is the basis of our analysis, where minx{- • •} denotes minimization with respect to X. The 
solution to this problem v* = {vD represents the first eigenvector that is normalized to \/]V and 
the first eigenvalue A is assessed as A = (v*)'^ Jv* /N . The introduction of a Lagrange multiplier 
A converts ([2]) to a saddle point problem with respect to an objective function, 

C{v,X) = -v^ Jv + Xilvl"^ - N) 

= A ^ v,^ - 2 ^ JijViVj - NX. (3) 

1=1 i>j 

Minimizing this function with respect to v and determining A so as to satisfy the stationary 
condition, \v\'^ = N, indicate that the solution is provided by the first eigenvalue, A = A, and 
the first eigenvector, v = v*. 

The key idea underlying our approach is to approximate the minimization problem of ([3]) 
with respect to v for fixed A by a bunch of those for effective quadratic functions of a single 
variable 



(2) 



Ci{vi\Ai, Hi) = Aivf - 2HiVi (4) 

(i = 1,2,... ,A^), where the coefficients of the second and first order terms, Ai and Hi, are 
determined in a certain self-consistent manner. In the cavity method, these coefficients are 
evaluated by a message-passing algorithm that yields the exact solution when the connectivity 
of Jij is pictorially represented by a cycle free graph (tree). 

To explain this, let us focus on an arbitrary index, i, assuming that matrix connectivity is 
specified by a tree. We use a notation, di, to represent the set of indices j that are connected 



directly to i with non-zero entries of Jij. We also introduce auxiliary variables Aj^i and Hj^i 
to represent the second and first order coefficients of j G di in the i- cavity system, which is 
defined by removing index i from the original system. In physics, such variables are occasionally 
termed cavity fields. 

A general and distinctive feature of trees is that all indices j £ di are completely disjointed 
from one another by removing the index, i. Let us assume that we add i into the z-cavity system 
retaining one link Jn for an index, I € di, removed. This creates a problem with minimizing a 
function with respect to the Vi and vj of j E di\l, where S\l indicates the removal of / from a 
set, *S', as 

^i,di\i(.Vi,{vj(,Qi\i}) = -2vi JijVj+ J2 {Aj-^iVj -'^Hj^iVj) . (5) 

jedi\i jedi\i 

Since i is connected to I only with Ju in the original tree, minimizing this function with respect 
to the Vj of Vj G di\l fixing Vi yields cavity fields concerning i in the Z-cavity system as 



72 

(6) 



A- ■ 

H.^i = y: (7) 

Given an initial condition, these equations are capable of assessing sets of the cavity fields, Aj^i 
and Hj^i, which are defined for all directed pairs of the connected indices, moving entirely over 
the graph. jf^/Aj^i and JijHj^i/Aj^i in Q and ([7]) represent the influences of j to i conveyed 
through connection Jij and are sometimes referred to as cavity biases. After the cavity fields 
are determined, Ai and Hi in (jH) are assessed by summing up the cavity biases from \/j E di 
as Ai = X - Y^j^Q-J^Aj^i and Hi = Yljedi-^ij^j^i/ Aj^i. This yields v* = Hi/Ai. Finally, 

adjusting A so that the normalization constraint, \v*\'^ = ~ = -^j is 

satisfied provides A. 

The above procedure can be regarded as a variant of the belief propagation developed in 
research on probabilistic inference [21] and is guaranteed to offer the exact result when the 
graph is free from cycles. When the graph contains cycles, the algorithm in ([6]) and ([7]) can still 
be performed; unfortunately, the result obtained is just an approximation. However, for our 
current purpose, we can generally utilize a much simpler and exact method that just repeats 
matrix multiplication as t;*"*"^ = (a/jv + J)v*', which provides A = lim(_>.oo Iv*"*""^!/!??*! — a 
and V* = \/]Vlimt_^oo ''^Vl''^*!) where a is a sufficiently large positive number and In denotes 
the N X N identity matrix. Therefore, our approach may seem less competitive in practice. 
However, the cavity approach is still useful for examining the properties of the eigenvalue problem 
introducing a macroscopic description as is explained below. 



3.2. Description by distribution of cavity fields 

Let us examine the behavior of the algorithm in 1^ and ([7]). To do this, we need to pay attention 
to the property of randomly constructed sparse matrices, which implies that the lengths of 
cycles in the connectivity graph of a matrix typically grow as O(lnA^) as — )• 00 [22j. This 
naturally motivates us to ignore the effects of self- interactions in the updates of ([6]) and d?]). 
We also introduce a macroscopic characterization of the cavity fields utilizing the distribution, 
q{A, H) = {Ya=i di)~^ Ya=i I]jG9i '^(^ ~ Aj^i)6{H - Hj^i). When a link in the connectivity 
graph is chosen randomly, the probability that the index of one terminal has a degree, k, is 



provided as 



r{k) = -J^P^. (8) 
Eto kp{k) 

This and deahng with 1^ and ([7]) as the elemental process for updating the cavity field 
distribution lead to an equation that determines q{A, H) in a self-consistent manner as 

fcmax — 1 / / k — \ /y2 \ / k — 1 ^ jj 

q{A, H)=Y^ r{k) / J\dA,dH,q{A,,H,) / Wa-A + ^-^UU-J^^ 

k=l j=l \ \ j=l 1 ) \ j=l 3 

where (■ ■ ■) j/" represents the operation of taking averages with respect to all relevant ^Tj's 
following Pi{Jj). After q{A^ H) is determined with this equation, the distribution of the auxiliary 
variables in the original system, Q{A, H) = Yli^i ~ Ai)S{H — Hi), is assessed as 




^max n h 11 

Q{A, H) = Y,p{k) / \{dAjdHjq{Aj,Hj) UIa 

k=0 •' 1=1 \ \ 




This make it possible to evaluate the quadratic norm per element of as T = = 
/ dAdHQ{A, H){H/Af . Moreover, the distribut ion of elements of the first eigenvector, v* , can 
be assessed as P{v) = N'^ ^^^^ 6{v - v*) = f dAdHQ{A, H)5{v - H/A). 

The argument provided in the preceding subsection implies that A should be adjusted so that 
T accords with unity. However, here we adopt an alternative approach to determining A. Let 
us assume a situation where ^ is solved by a method of successive iteration, which leads to an 
exact result when the graph is free from cycles. Equation ^ guarantees that for large A, A is 
distributed over large values in q{A,H). This means that for sufficiently large A, the absolute 
values of H are mostly reduced by each iteration and, therefore, the marginal distribution, 
q{H) = J dAq{A, H), converges to S{H) implying T — )■ as the number of iterations tends to 
infinity. However, as A is decreased from sufficiently large values, A can take smaller values in the 
distribution and larger values of \H\ could appear with considerable frequency in each iteration. 
This indicates that the frequencies with which \H\ is reduced and enlarged are balanced at a 
certain value of A, for which non-trivial distribution q{H) 7^ S{H) becomes invariant under the 
cavity iteration of Q and T is kept as a finite constant. If A is lowered further, the frequency 
of enlargements will overcome that of reductions, which will eventually make T tend to infinity. 
These imply that one can characterize the first eigenvalue, A, as the value of A for which non- 
trivial distribution q{H) / S{H) emerges by solving The resulting cavity field distribution, 
q{A, H), offers the distribution of the first eigenvector elements, P{v), of any finite value of T by 
applying appropriate rescaling with respect to H. This is also reasonable because eigenvalues are 
generally irrelevant to the values of the normalization constraint with respect to eigenvectors. 

The validity and utility of this characterization of the eigenvalue problem are examined by 
applying it to three examples in the next section. 



4. Application to three examples 
4-1- Single degree model 

In the first example, we consider cases where all indices have a certain identical degree, K, 
which is characterized by p{k) = 5k, k, where 5ij denotes Kroeneker's delta, and the non-zero 
entries are i.i.d. following the binary distribution of ([1]). In such cases, the marginal distribution, 
q{A) = f dHq{A, H), is provided in the form of q{A) = 6{A — A*) since J''^ = always holds for 




Figure 1. (a): First eigenvalue A versus A for single degree model of -ftT = 4 and J = 1. The 
full curve represents the theoretical prediction of ()17p while the markers denote the averages 
of 2000 experimental results for = 256 (red), 512 (green) and 1024 (blue) systems, (b): 
M = \N~^^^^-^v*\ versus A for the same experiments as (a). Red, green, and blue markers 
correspond to = 256, 512, and 1024 as well. The inset has scaling plots obtained by conversion 
of M N^/'^M and A N^/'^{^ - Ac)/Ac. In both (a) and (b), the vertical straight lines 
(magenta) stand for Ac = l/\/3 = 0.577. . .. 



MJ that are sampled from ([TJ. Equation ([9]) indicates that A* satisfies A* = \ — {K — 1)J'^/A*. 
This yields 

^.^x±^/^EWEW^A'ix:(K-i)r-), (11) 

which along with ^ offer the equation for determining the marginal distribution, q{H), in a 
self-consistent manner as 



Tuning A so that a non-trivial distribution, q{H) ^ S{H), satisfies this equation yields the first 
eigenvalue, A. Paying attention to the first and the second order moments, mi = J dHq[H)H 
and 7712 = / dHq{H)H^ , is sufficient for this purpose. This provides a generalized eigenvalue 
problem described by a couple of equations 

A(A"-1)J , , 

= A*(A;(K-1)J^) "^^' 

= (^*(MK - ^)j2))2("^2 - + (^^(AlfA:"- !y2)"^0 ' ^''^ 

which requires the existence of a solution to (7711,7712) 7^ (0,0). There are two possibilities that 
will satisfy this requirement. The first is characterized by \mi\ > 0, which in conjunction with 
(fT3]) offers 

A(i^-l)J 

^*(A;(K-1)J2)- ^ ' 




Figure 2. P{v) for (a): A = 0.5 and (b): A = 0.9 of single degree model of K = A. For 
both plots, the bars represent histograms obtained from 100 experiments of = 1024 while the 
curves stand for theoretical predictions obtained from (jl2p and (jlOp by means of a Monte Carlo 
method of 10^ populations. In handling the experimental data of (b), we employed conversion 



V* — )• —V* for data of Xl^^ < in order to break the mirror symmetry between v* and —v* 
which is intrinsic in the eigenvalue problem. 



The second is the case of mi = and m2 > 0, which along with (|14p provide 

-,_ {K-l)J' 

(^*(A;(K- 1)J2))2- ^ 

Solving ()15p and ()16p with respect to A, we finally obtain an expression of the first eigenvalue, 



A 



(( K- 1)A + 1/A) J, A>Ac 
- IJ, A < Ac 



(17) 



where Ac = 1/\/K — 1. A > Ac and A < Ac correspond to the cases of \mi\ > and mi = 0. 

To justify the prediction of ()17p . we carried out numerical experiments for the systems of 
K = 4 and J = 1, whose results are in figures [T] (a) and (b). Figure [T] (a) has the plots 
of A versus A, which are in excellent agreement with ()17p for relatively large A. However, 
there are non- negligible finite-size corrections for relatively small A, which makes it difficult 
to accurately detect the critical value, Ac. To overcome this difficulty, we turn to the profiles 
of M = N-^ J2i=i < ' which are shown in figure [1] (b). The raw experimental data of M 
vary smoothly with A and do not exhibit any singularity at A = Ac either. Nevertheless, 
the data rescaled as M — )• N^^^M and A — )■ A^-'^/^(A — Ac)/Ac support a scaling hypothesis, 
M = N^^/^F{N^/^^{A — Ac)/ Ac) (inset), which validates the transition at Ac assuming that 
F{x) behaves as 0{x^^'^) for x — )■ +00 and vanishes for x — t- —00. A similar scaling hypothesis 
has been assumed in the examination of principal component analysis before ^lOJ . 

Besides the eigenvalue, one can also assess the distributions, P{v), of elements of the first 
eigenvector, v* , by numerically solving q{H) with Monte Carlo (population dynamics) methods. 
The prediction with our approach is also in excellent agreement with the experimental results for 
both cases of A < Ac (figure [2] (a)) and A > Ac (figure [2] (b)) when | A — Ad /| Ad is sufficiently 
large. 



4-2. Limit of large degrees and infinitesimal entries 

The second example is offered by assuming that the average and the variance ofp{k) are provided 
as k and 0{k), respectively, and those of pj{Jij) are given as fiJ/k and J^/fc for sufficiently large 
k while fi > and J > are certain finite constants. The assumption on the degree distribution, 
p{k), covers the cases described by truncated Poissonian distributions of large mean values in 
which indices whose degrees are sufficiently larger than the means are eliminated from the 
basic graphs of Erdos-Renyi type [3j. Being combined with the assumption on pj{Jji), this, 
in conjunction with the law of large numbers, guarantees that the marginal distribution of A 
is provided as q{A) = 5{A — j4*(A; J^)), where the functional form of A*(A; J^) is identical 
to that of (|lip . Inserting this into (jl2p and the resulting equations with respect to the first 
and the second order moments offer conditions of 1 = pJ/A*{X; J'^) and 1 = J^/(A*(A; J^))^, 
respectively, which are counterparts of and (fTUj) . This provides the first eigenvalue as 

A = I > !' (18) 

/X > 1 and p, <1 correspond to situations of |mi| > and mi = 0. 

In the current case, the central limit theorem guarantees that q{H) converges to a distribution 
of the Gaussian type. Consequently, this also makes it possible to analytically express the 
distribution, P{v), of the elements of the first eigenvector in a Gaussian form. Under the 
constraint of T = 1, this yields 

r (2^(1 -(M(^))2)-V2 exp (-(z;-M(m))V(2(1-(M(/.))2))), ^ > 1, 
^^^^-\ (2^)-V2exp(-z;72), ^ < 1, ^'^^ 



where M(//) = ±y^l - l/fi"^ 



4-3. Mixture of multiple degrees 

The strategy we employed for analyzing the preceding two examples is summarized as follows. 
We first evaluate the marginal distribution, q{A) = J dHq{A, H), of the second order cavity 
fields in the form of a single delta distribution, q{A) = d{A — A*). This enables us to deal 
with ^ as a constant, A*, in assessing the marginal distribution, q{H) = J dAq{A, H), of the 
first order cavity fields. Consequently, the original eigenvalue problem is reformulated as a 
generalized eigenvalue problem with respect to q{H). This imposes certain conditions on the 
second order cavity field, A*, which is a function of A. The first eigenvalue is evaluated by 
solving the conditions with respect to A. 

Unfortunately, such clear decoupling of the first and the second order cavity fields cannot 
generally be exploited in handling the eigenvalue problem precisely. Even when p{k) takes finite 
values for multiple A;, the marginal distribution, q{A), constitutes a closed equation with no 
necessity for considering the first order cavity field, H, as 



q{A)=Y^r{k)\Y^dA,q{A,)U\A-\^Y.±\) ' (20) 

k=\ 3=1 \ \ j=l 1 J I J 

which, however, generally makes q{A) a continuous distribution. This prevents us from handling 
^ as a constant in assessing the marginal distribution, q{H), and we eventually have to deal 
with the joint distribution, q(A,H), directly. This requires much more effort in analysis than 
that in handling the marginal distributions, q{A) and q{H), separately. 




Figure 3. (a): First eigenvalue A versus A for mixture model of p{k) = 0.9(5^^4 + 0.15k,s and 
J = 1. The full curve represents the theoretical prediction assessed from ()23p by means of a 
Monte Carlo method of 10^ populations. Large statistical fluctuations due to a small portion of 
samples of ^ ~ prevented us from accurately assessing the relation below A ~ 4.4, for which 
data have not been shown. The markers stand for data evaluated similarly for figured) (b): 
M = \N^'^ ^i=i versus A for the same experiments as (a). The scaling plots of M — J- N^^^M 



and A N^/^{A - Ac) /Ac (inset) indicate Ac 
lines (magenta) in (a) and (b). 



0.611, which is represented as vertical straight 



To avoid this, let us move forward with our analysis, approximately, ignoring the correlations 
between A and H. Applying this approximate treatment to the assessment of the first and the 
second order moments of H by using ([9]) provides two conditions 



I dJp,{J)J^ |^g\(fc)(fc-l)^ (1 dAq{A)A-^ 
I dJpj{J)J^^ (^^^r{k){k - 1)^ dAq{A)A-' 



(21) 
(22) 



where q{A) is the solution to (j20p for given A. Equations ()2ip and (j22p can be regarded as 
corresponding to generalizations of (jl5p and ()16p . 

We examined the utility of (j2ip and (j22p by applying them to cases of the bimodal degree 
distributions of p{k) = (1 - f)6k,4 + fSk,s (0 < / < 1) and pj{Jij) of with J = 1. For 
equation ([2T]) indicates that 



^ = '^'' ((E^(^)(^-1)) (/ dAq{A)A-'^'^ 



-1 



(23) 



provides the relation between first eigenvalue A and A by dealing with A = A as a control 
parameter, as long as the right hand side is less than unity and greater than a certain critical 
value, Ac. Figure [3] (a) compares the theoretical prediction of (|23p assessed with the Monte 
Carlo method and the results of numerical experiments for / = 0.1. Despite the fact that the 
treatment is not necessarily exact, the theoretical prediction agrees with the experimental results 
with excellent accuracy for relatively large A. 




Figure 4. P{v) of mixture model p{k) = (1 — /)(5fc,4 + /<5fc,8 for (a): / = 0.1 and (b): / = 0.9. In 
both plots, the red, green and blue curves were obtained from 2000 experiments setting A = 
for N = 256, 512 and 1024, respectively. 

Rescahng M = |A^"^I]iIi<l and (A - Ac)/Ac with iVV6 and N^^^, respectively, as has 
been assumed in the single degree model for the experimental data, indicates a critical value 
of Ac — 0.611 (figure [3] (b)). This should be characterized by satisfying (j22p in the current 
approach. However, it is difficult to accurately determine Ac with the Monte Carlo method in 
practice because the right hand side of ()22p greatly depends on the diverging contribution from 
a small portion of A ~ at criticality, which is considerably sensitive to statistical fluctuations 
in the sampling. Another source of the difficulty is that ()20p can make the support of q{A) 
spread to a region of negative A for relatively small A. The negative values of A imply that for 
certain indices i, (jH) is minimized at Vi = ±00, which may correspond to large elements of v* 
that diverge as tends to infinity. Such elements have been argued to be defects in several 
earlier studies before |12l [T3l [15]. The experimental data indicate that the divergent behavior 
of the small fraction of the first eigenvector elements, which may be related to the defects, is 
more significant as / is relatively smaller (figures H] (a) and (b)). Refining the current analysis 
so that it can accurately handle such divergent elements is currently under way. 

5. Summary 

In summary, we developed a methodology for analyzing the first eigenvalue problem of large 
symmetric random sparse matrices utilizing the cavity method of statistical mechanics. The 
scheme we developed makes it possible to assess the first eigenvalue and the distribution 
of elements of the first eigenvector on the basis of a functional equation concerning a joint 
distribution with respect to two kinds of cavity fields. Its validity was tested and confirmed 
by using two analytically solvable examples. Unfortunately, directly employing the approach 
we developed is technically difficult in general cases where the matrices are characterized by 
multiple degrees. However, we demonstrated that an approximate treatment that ignores certain 
correlations between the two kinds of cavity fields offers excellent capabilities for assessing the 
first eigenvalue when each entry of the matrices is i.i.d. following a distribution that has a 
sufficiently large positive mean value. However, singular behavior can be observed in the cavity- 
field distribution when the average of the matrix entries is not a sufficiently large positive 
value. Comparison with experimental results suggested that this may be related to the divergent 
elements of the first eigenvector, which have been argued in earlier studies. 

In some problems, not only the first but also the second eigenvalue is of utility [23]. In 



addition to making refinements to the current study, analyzing the n-th eigenvalue (n = 2, 3, . . .) 
by utilizing the cavity method may be an interesting project for future work. 
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